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The recent discovery that for large Hilbert spaces, almost all (that is, typical) Hamiltonians have 
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irreversibility and thermalization. Here we give numerical evidence that many-body lattice systems 
generically approach typicality as the number of subsystems is increased, and thus provide further 
support for the eigenstate thermalization hypothesis. Our results indicate that the deviation of 
many-body systems from typicality decreases exponentially with the number of systems. Further, 
by averaging over a number of randomly-selected nearest-neighbor interactions, we obtain a power- 
law for the atypicality as a function of the Hilbert space dimension, distinct from the power-law 
possessed by random Hamiltonians. 
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I. INTRODUCTION 

In the last few years tremendous progress has been 
made in understanding how irreversibility and thermal- 
ization emerge from the reversible evolution of quantum 
mechanics [TI-IT3]. Recall that traditional statistical me- 
chanics requires three basic assumptions, that together 
imply that the equilibrium state of a small subsystem is 
the Boltzmann state [I21[T1]. Let us call the small subsys- 
tem the system, and the large system the universe. The 
three assumptions are: i) The state of the universe is a 
uniform mixture over all its accessible states, and thus all 
states within some small energy band; ii) Over the en- 
ergy range of the system, the density of energy levels of 
the rest of the universe (often called the hath) increases 
exponentially with energy, and iii) that the coupling of 
the system to the rest of the universe is small on the scale 
of the energy levels of the system (weak coupling) . 

The modern understanding removes the need for the 
first, unjustified and rather odd assumption, that the 
state of the universe is mixed. It turns out that almost 
every pure state of the universe, within a given energy 
band, gives the same state for the system (when the rest 
of the universe is traced out) as the uniformly mixed 
state on the same energy band (note that this uniformly 
mixed state is the micro- canonical state for that energy 
band). When almost all members of a large set have 
some property in common, these members are referred 
to as typical [15] This "canonical typicality" (21 1^ prop- 
erty of pure states provides a compelling reason as to 
why the equilibrium state of a large isolated system is 
obtained correctly by assuming it is mixed (namely that 
it is the micro-canonical ensemble). Since almost all pure 
states are typical, the universe can be expected to spend 
almost all its time in these states, and the system will 
therefore remain close to the micro-canonical state as far 
as every small subsystem is concerned. 

The above result is not the end of the story. The 
typicality of pure states implies that for large (high- 
dimensional) vector spaces, almost all Hermitian oper- 
ators (and thus almost all potential Hamiltonians) also 



have a typicality property [101 [H]. Specifically, if we 
select a Hamiltonian "at random" by choosing its eigen- 
states randomly and independently from the Haar mea- 
sure, then almost all Hamiltonians will have typical eigen- 
states. This is the typicality property of Hamiltonians. 
It is also worthwhile to note that if almost all Hamiltoni- 
ans are typical under one "reasonable" measure, then we 
can expect them to be typical under other "reasonable" 
measures. While this conclusion is far from rigorous — 
we have not defined the word "reasonable" — we can 
nevertheless expect that in general "random" Hamiltoni- 
ans will have typical eigenstates, even if their eigenstates 
are not picked precisely from the Haar measure. 

The concept of Hamiltonian typicality is important for 
the following reason. If the Hamiltonian of a many-body 
system is typical, and its eigenvalues are sufficiently non- 
degenerate, then along with a few additional, easily jus- 
tifiable conditions (e.g. the individual subsystems are 
weakly interacting) [TUl [T2] , the many-body system will 
thermalize. By "thermalize" we mean that the density 
matrix of every small subsystem relaxes to a steady-state, 
and this steady-state is the Boltzmann state. This result 
was proved only recently by Riera, Gogolin, and Eisert 
et al. [12j). while prior to this, strong arguments along 
these lines were given by Golstein et al. [lOl [H] (see also 
the closely-related papers by Riemann [51 [S]). Note that 
we have not provided any evidence yet that many-body 
Hamiltonians are typical, but we will turn to this ques- 
tion shortly. 

The reason that typical Hamiltonians lead to thermal- 
ization can be outlined fairly simply. Firstly, the eigen- 
states of a typical Hamiltonian are typical, meaning that 
if the universe is in any one of them, every small subsys- 
tem will be in the state predicted by the micro-canonical 
ensemble for the universe. In fact, it had previously been 
conjectured independently by Deutsch |T5] and by Sred- 
nicki JTj that the Hamiltonians of large systems have this 
property, and this conjecture is now termed the eigen- 
state thermalization hypothesis, or ETH [51 I18| . The 
next step is to examine what happens when we write 
the initial state of the universe in the basis of the uni- 
verse eigenstates. If the initial state of the universe is 
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li'i^)) = J2n^ri\En}, where the states |i?„) are the en- 
ergy eigenstates, then the density matrix of the universe 
at time t is 

n 

We now note that because the energy gaps, A„ — -~ 
are non-degenerate, the off-diagonal terms — those 
with n ^ m, will mutually dephase, and since each term 
is sinusoidal, and has zero mean, these terms can po- 
tentially cancel each-other out. Specifically, if we take 
the trace over all but one subsystem, so as to obtain the 
density matrix of that subsystem, then we have 

p(t) = ^|c„|2Trb[|i?„)(i?„|] 

n 

-f c«CTrb [\En){E^\] eM-KEn - E,n)t/h], 

where Trb [• • • ] denotes the trace over the "bath" part 
of the universe. Since each off-diagonal term is time- 
dependent, for the subsystem to reach a steady-state, 
the partial traces of the off-diagonal elements must can- 
cel themselves out. Showing that they do requires con- 
siderable technical detail [19], but if we assume that it 
does reach a steady-state, then this steady-state must be 
given by the diagonal terms alone. Now, every eigenvec- 
tor \En) gives the same density matrix for the system, 
and this is Pmicro-can, being the state that results from 
starting with the micro-canonical state, and tracing out 
the rest of the universe. So we have 

Pss = lim p{t) = V IcnpTrb [\E.n){En\] 

i— foo ^ — ^ 

71 
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It now follows from the usual arguments of statistical me- 
chanics that pss will be equal to the Boltzmann state so 
long as 1) each subsystem interacts sufficiently weakly 
with the rest of the subsystems (the bath), and 2) the 
density of the energy levels of the bath increases exponen- 
tially with energy. For many-body systems this second 
assumption follows from the combinatorics of combining 
many identical systems together, so long as the coupling 
between the systems is small (perturbative) compared to 
the gaps between their individual energy levels [12] . 

To summarize, if the Hamiltonian of a many-body sys- 
tem is typical, and its energy spectrum has sufficiently 
non-degenerate energy gaps, then it will thermalize. This 
thermalization will be micro-canonical, and will also be 
canonical if the couplings between the subsystems are 
sufficiently weak. This suggests the following explanation 
for the ubiquity of thermalization in nature: since almost 
all Hermitian operators for large systems are typical, it 
is very likely that the Hamiltonian of any specific many- 
body system will be typical, and thus will thermalize. 



We suggest, however, that there may be a piece missing 
from this picture. As we discussed above, if one picks a 
Hamiltonian using some randomization procedure, then 
indeed it can be expected to be typical. But the Hamil- 
tonians of many-body systems are not obtained in this 
way. They are built in a simple and ordered manner, usu- 
ally by short range, few-body interactions between simple 
systems, where the interactions are dictated by an often 
highly symmetric grid. To obtain a full understanding of 
the origin of thermal behavior, ideally one would show 
that the procedure that generates many-body Hamilto- 
nians typically results in Hamiltonians that are both typ- 
ical and have highly non-degenerate energy gaps. 

We do not attempt to prove here that many-body 
Hamiltonians are generically typical. But motivated by 
this question, we obtain numerical results showing how a 
chain of spin systems approaches typicality as its length is 
increased. To do this we define a measure of the typicality 
of a Hamiltonian, and examine how this scales with the 
dimension of the relevant Hilbert space. We compare this 
with the scaling of the typicality exhibited by random 
Hamiltonians as their size increases. We further provide 
numerical evidence, using a chain of spin-1 systems, that 
this approach to typicality is generic — that is, that it 
occurs for almost all interaction Hamiltonians that one 
can choose for the nearest-neighbor spin-spin coupling. 
We note that previous numerical evidence for the ETH, 
and thus the typicality of many-body Hamiltonians, has 
been presented in [HI I20j . Prior to this numerical anal- 
ysis had shown that non-integrable spin systems have a 
typical eigenvalue distribution (being the Wigner-Dyson 
distribution, see below) [51] [52] . Earlier pioneering work 
on the thermodynamic behavior of spin chains is given 
in [53]. 

Before we launch into our numerical analysis, we feel 
it is worth noting a few more things regarding typical- 
ity and many-body systems. Firstly, it is telling that 
random Hamiltonians have been shown to correctly re- 
produce global aspects of the eigenvalue distributions of 
many-body systems (see, e.g. [Ml [25]). If indeed the 
Hamiltonians of many-body systems are typical in vari- 
ous respects, then this would account for the above fact. 
The procedure used to obtain the random Hamiltonians 
in question is to select each of their independent matrix 
elements independently from a zero-mean Gaussian prob- 
ability density. If the matrix elements are purely real, 
then the resulting "ensemble" of Hamiltonians is called 
the Gaussian orthogonal ensemble, or GOE. (There is a 
similar procedure for selecting Hamiltonians with com- 
plex elements, but the GOE is sufficient for our purposes 
— it gives all Hamiltonians that are time-reversal invari- 
ant). Not only are the eigenvectors of GOE Hamiltonians 
typical, but their eigenvalues are highly non-degenerate. 
This is the famous "energy-level repulsion" , in which the 
distribution of the gaps between adjacent energy levels is 
small for small gap-size. The distribution of the adjacent 
gaps is called the Wigner-Dyson distribution. The fact 
that the eigenvalues of almost all GOE Hamiltonian's do 



3 



follow this single distribution implies that this is a "typ- 
ical" property of GOE Hamiltonians. Thus GOE Hamil- 
tonians have stronger typicality that the Hamiltonians 
we have been discussing above, for which it is only the 
eigenvectors that are chosen at random. Experimental 
investigations of nuclear (many-body) systems have con- 
firmed that they also follow the Wigner-Dyson distribu- 
tion ^26, , and thus share this typicality property. Finally 
we note that the GOE ensemble also has the important 
property that it is invariant under all orthogonal trans- 
formations (231 ■ following, when we use the term 
"random Hamiltonian" , we will always mean a Hamilto- 
nian selected from the GOE ensemble. 

The question of the typicality of many-body systems is 
made more curious by the fact that some non-integrable 
many body systems do not have typical Hamiltonians. 
This occurs when the Hamiltonians of each of the sub- 
systems varies substantially from system to system (an 
example of this is a spin- 1/2 lattice immersed in a ran- 
domly varying magnetic field) [271134) . In this case the 
eigenstates of a lattice system are localized on the lat- 
tice, a phenomena first suggested by Anderson in his 
seminal paper on localization |35j . Though less relevant 
in this present context, there is another, more special 
class of systems that do not thermalize: systems that 
contain conserved quantities in additional to the energy. 
In this case the eigenstates still tend to be typical, but 
now they are typical states within subspaces whose states 
are degenerate with respect to all the conserved quanti- 
ties. Such systems therefore still relax to a steady-state, 
but it is not the Boltzmann state, but a "generalized" 
Boltzmann state that takes into account the additional 
conserved quantities |36j . Integrable systems are an ex- 
treme case of this, in that they have the same number 
of conserved quantities as the number of subsystems [37l - 
HD] , Because they have so many conserved quantities, 
the conserved subspaces are too small for typicality to 
play any role, and as a result they do not usually settle 
down to a steady-state at all (although they sometimes 
do thermalize for certain initial conditions |41j and ex- 
hibit diffusive behavior [i^H5] V 

In the following section we define a measure of the 
"atypicality" of a Hamiltonian, along with a quantity 
that indicates the extent to which a Hamiltonian is de- 
generate. In Section [ITT] we describe our example systems 
and present the numerical results. Section ITV] concludes. 



II. A MEASURE OF ATYPICALITY 

Consider a many-body system consisting of N qubits, 
in which the energy gap between the excited and ground 
states of each qubit is HA. Because we are interested in 
thermalization, we are free to make the coupling strength 
between each pair of qubits, Hg, as small as we wish. In 
the limit of small g {g A), the spin-spin interaction 
couples only states that are degenerate with respect to 
the free Hamiltonian, and thus states in which the same 



number of spins are pointing up. (This degeneracy of the 
free Hamiltonian should not be confused with the degen- 
eracy of the full Hamiltonian — as explained above, the 
latter must not have a significant fraction of degenera- 
cies if the system is to thermalize.) As is usual, we will 
refer to these degenerate subspaces as sectors. It follows 
that thermalization happens separately on each sector. 
The Hamiltonians that generate the thermalization are 
therefore the sub-blocks of the interaction Hamiltonian 
corresponding to each sector. If the spin chain has N 
spins, then we will denote the sector in which M spins 
are up as Nm, and the interaction Hamiltonian on this 
space as Hm,m- We will further write the eigenstates of 
Hnm as \n)M,M- 

Let us denote the state of the universe that is maxi- 
mally mixed on the sector Nm by 'E^^m- Define the state 
of a single spin, given by tracing out all other spins from 
the state Sjv^m as pn,m- We will denote the elements 
' ?) 

of pn,m by p)^ Ij, where i and j are "up" or "down". 

The population of the spin- up state is therefore Ptv a"'''' ■ 
One can easily determine pn,m merely by counting the 
number of basis states of Nm for which a single chosen 
qubit is in the up-state, and dividing this by the total 
dimension of the space. The dimension of ^n.m is ^N 
choose M", given by N\/{M\{N - My.), and the num- 
ber of states in which a chosen qubit is in the up-state 
is "iV — 1 choose M — 1" . The micro-canonical ensemble 
therefore implies that the population of the up-state of 
every qubit is 



„(UP:UP) 

Pn.m 



N choose M 



{N - 1) choose (M - 1) 



M 

77' 



(2) 



The off-diagonal elements of pn,ai ^re zero, and of course 

(down, down) 71 r /tvt 

Pn,m ' = 1-M/N. 

The property of Hm.n in which we are interested, is 
the extent to which each of its eigenstates places every 
spin in the state Pn,m- ^'^^ denote the n*'' eigenstate 
of the universe, in the sector Nj^i, by \En)N,M- Note 
that there are "A^ choose M" eigenstates in this sector. 
The state of the j*^ qubit, when the universe is in this 
eigenstate, is 



PNM{n,j) = Trj [\En)N^M{En\N.M\ 



(3) 



where Trj[---] denotes the trace over all but the j"^ 
qubit. A measure of the deviation of the density matrix 
PN^Aiin^j) from that predicted by the micro-canonical 
ensemble is given by the difference between the popula- 
tions they predict for the spin-up state. If we denote the 
spin- up state by |up), then this difference is 



Sj,n = (up|pjv,Af(", j)|up) - (up|pAr,AJ-|up) 

M 



= (up|pAr3,/(r7,,j)|up) 



A 



(4) 



A root-mean-square measure of the typicality of Hm,n is 
obtained by averaging the square of this difference over 
all the spins and all the eigenstates in the sector Nm- 
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Since there are "N choose M" eigenstates in this sector, 
this rms measure is 



M!(7V- M)! 
NIN 
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(5) 



We will refer to S^ms as the atypicality of the Hamiltonian 
in the given sector. 

We must also verify that Hm,n does not contain a sig- 
nificant fraction of degenerate eigenvalues, and that this 
remains true as N increases. This is because the eigen- 
vectors are only well-defined by the Hamiltonian if their 
corresponding eigenvalues are non-degenerate, and thus 
the question of typicality is meaningless if there is sig- 
nificant degeneracy. This is paralleled by the fact that 
degeneracy of the eigenvalues implies immediately degen- 
eracy of the energy gaps, and thus destroys the connec- 
tion between typicality and thermalization. To quantify 
the fraction of degenerate eigenvalues, we introduce the 
following rather crude measure, which is sufRcient for our 
purposes. We calculate all the energy gaps between ad- 
jacent energy levels. We then calculate the average value 
of the energy gap, which we denote by (e), and define 
a threshold Ethresh = (£)/10. Finally, we determine the 
maximum number of energy gaps whose combined sum is 
less than Ethresh- This maximum number, divided by the 
total dimension of the space, we will call the "degeneracy 
fraction", and denote it by /dog- 



III. NUMERICAL RESULTS 
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FIG. 1. (color online) Here we show the deviation from typ- 
icality of various sectors of a spin-1/2 chain, as the length of 
the chain is increased, and compare this to that for random 
(GOE) Hamiltonians of the same size. On the x-axis we plot 
the dimension of the sector. Dark-solid line: if the chain has 
A'' spins, then the sector has M = trunc(Ai'/2) spins in the 
up-state, where the function trunc(-) discards the fractional 
part of its argument (only odd values of A'^ are plotted for 
these sectors — see text); dark-dashed line: the sector has 
M = trunc(A'^/2) — 1 spins in the up-state; light-solid line: 
the sector has M = trunc(A'^/2) — 2 spins in the up-state; 
light-dashed line: the deviation from typicality of random 
Hamiltonians as a function of the dimension. The inset gives 
the corresponding "degeneracy fraction" for the sectors (see 
text), as a function of their dimension. 



We use as our first numerical example a one- 
dimensional lattice of spin-1/2 systems (a chain of 
qubits), with nearest-neighbor interactions. The Hamil- 
tonian for this many-body system (which we will also 
refer to as "the universe") is 

N N-1 

n=l j=l 

where ui"'' is the Pauli ^-operator for the n*'' spin, and aj 
is the interaction operator for spin j. All the interaction 
operators are identical, and chosen so that the system is 
non-integrable. We set the interaction operators to be 
aj — cosOgz + smOox with 9 = 0.3757r. 

We wish to examine how the rms deviation from typi- 
cality, 5, as well as the degeneracy fraction, /dog, changes 
as the size of the spin chain is increased, and we do this 
by fully and exactly diagonalizing the Hamiltonian on a 
single sector for up to 17 spins. It turns out, somewhat re- 
markably, that for sectors in which exactly half the spins 
are pointing up (that is, M — N/2) all the eigenstates 
are perfectly typical (that is, 5 = 0) for any number of 
spins (at least up to = 16). Presumably this is a result 
of a symmetry in this case. However, thermalization re- 
quires all the sectors to have typical Hamiltonians, and 



so we examine 5 for four other sectors as we increase the 
length of the chain. The first three sectors are those with 
M = trunc(7V/2) (for N odd), M = trunc(7V/2) - 1, and 
M = trunc(A^/2) — 2, where the function trunc(-) dis- 
cards the fractional part of its argument. The last sector 
we examine is that with M fixed at the value 6 as TV is 
increased. 

In Fig. [T] we display a log-log plot of 5 for our first 
three sectors as the length of the chain, TV, is increased. 
The value on the a;-axis is the dimension of the sector, 
D, which increases exponentially with N for large TV. 
In the same figure we plot the value of 5 for random 
Hamiltonians as a function of their dimension. For ran- 
dom Hamiltonians, the value of 5 fluctuates somewhat 
from one sample Hamiltonian to another, as one would 
expect. One also expects these fluctuations to decrease 
as the dimension of the sector increases. To reduce the 
fluctuations we average 5 over 50 samples, and it is this 
average value, ((Sran) that we show in Fig. [l] The be- 
havior of ((^ran) scttlcs down quickly to a power law as 
the dimension increases. From the analyses in |31 13 Hi] , 
one expects that the deviation for random Hamiltonians 
will scale asymptotically as 1/sqrtD, and our numerical 
results confirm this. 

From Fig. [l] we see that the atypicality decreases mono- 
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tonically for the three sectors, although it has not settled 
into a power law. The degeneracy fraction also decreases 
with D. Since the curvature of \og{5) verses log(D) is 
positive, it is not clear whether the atypicality continues 
to decrease without bound as D — oo. What is clear is 
that 5 does not decrease as fast as it does for random 
Hamiltonians. 

The behavior of the atypicality for sectors in which M 
is fixed at a small value, while increases, is quite dif- 
ferent from that for the three sectors we examined above 
where both M and N increase. We have calculated 5 for 
sectors with M = 6, and N running from 13 to 20. For 

= 13 the sector has size D — 1716, and for N — 20, 
D = 38, 760. However in this case 5 does not decrease 
with increasing size: the values we obtained were, for in- 
creasing N, 5 = (399,415,448,441,441,434,434,418) x 
10^^. This is certainly interesting, but since both N and 
M are large for many-body systems at any appreciable 
temperature, it poses no problem for the ETH. 

We also wish to know whether many-body systems ap- 
proach typicality for almost all choices of the two-body 
interaction. To this end we now consider chains of spin-1 
systems (qutrits), as this will allow us to explore a more 
extensive range of interaction Hamiltonians. For a lat- 
tice of spin-1/2 systems, there is very little freedom in 
choosing the interaction, especially if we demand that 
this interaction operator is a product of identical opera- 
tors for each system. For a spin-1 chain each system now 
has three energy levels, which we choose to be equally 
spaced in energy, and the interaction operator for each 
system is a 3-by-3 matrix. The Hamiltonian for this chain 
is 

N N-1 
n=l j=l 

where ji"^ is the z-component of the spin-1 angular mo- 
mentum operator for the n*'' spin, and Aj is the inter- 
action operator for the j*''. All the interaction operators 
Aj — A are identical for every spin. 

The reason we choose the energy levels for every spin- 
1 system to be equally spaced is to provide degenerate 
sectors, just as for the spin-1/2 chain. Since the three en- 
ergy levels are — A, 0, and A, for a chain of A'^ systems we 
will examine the degenerate subspace with energy equal 
to (as this is the largest degenerate subspace). This 
time the diagonal elements of the ideal thermal density 
matrix have two degrees of freedom, so we include both 
in our measure of typicality. That is, in calculating S, 
we sum the squared-differences for two of the diagonal 
elements. 

We restrict ourselves to interaction operators. A, that 
are zero on the diagonal, and this leaves us with the free- 
dom to chose the three real off-diagonal elements. (In fact 
since the overall scaling is unimportant, the space of the 
interaction operators is two-dimensional.) We proceed 



by picking a value for A from the GOE, and calculate 5 
for the sector with energy 0, for chains containing 6 to 
11 spins. In Fig. [2]^a) we show ^ as a function of the sec- 
tor dimension for 21 randomly sampled interactions A. 
This shows that for the majority of these interactions, 
the atypicality decreases monotonically with the length 
of the chain. In the inset in Fig. [2]Jb), we show the de- 
generacy fraction as a function of the sector dimension, 
and this also decreases as the dimension increases. 

We now average over the atypicality, 6, for all 21 sam- 
ples shown in Fig |2ja) , and this average is plotted in 
Fig. [2jb). After the first data point, the average value 
of S appears to decrease as a power of the sector dimen- 
sion (a straight line on the log- log plot), and so we de- 
termine the least-squares best-fit line though the data- 
points. This line is also shown in Fig.[2][b), and gives the 
power law as (5 oc where a — 0.204 ± 0.003. 



IV. CONCLUSION 

We have shown, for nearest-neighbor chains of both 
qubits and qutrits, that as the length of the chain in- 
creases, the Hamiltonians within the degenerate sectors 
of the non-interacting spins (those responsible for ther- 
malization) become increasingly typical. For a chain of 
spin-1 systems, we found a clear indication that the atyp- 
icality, averaged over a set of choices for the nearest- 
neighbor interactions, scaled as a power-law in the dimen- 
sion of the sector. This provides considerable support 
for the conjecture that many-body systems are generi- 
cally typical, and thus for the eigenstate thermalization 
hypothesis. 

The exponent with which the atypicality scales for the 
nearest-neighbor spin-1 chain is not the same as that for 
random (GOE) Hamiltonians. Perhaps further investiga- 
tions of the way in which atypicality scales for many-body 
systems will help to shed light on the origin of typical- 
ity in these systems, and whether this typicality can be 
understood as resulting from their structure. Finally, we 
note that since the dimension of the degenerate sectors 
scales exponentially with the length of the chain, our 
results indicate that the atypicality also decreases expo- 
nentially with the chain length. 
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FIG. 2. (color online) The deviation from typicality of a specified sector (see text) of a nearest-neighbor spin-1 chain, measured 
by a single real number 5. As the length of the chain is increased, the dimension of the specified sector also increases, and 5 
is plotted here as a function of this dimension, D. (a) Here we plot 5 for 21 randomly-chosen nearest-neighbor interactions, 
(b) The average value of 5, (S), averaged over the 21 different nearest-neighbor interactions. The circles (connected by the 
dark line) give the data-points for (S). The light line is the (least squares) best-fit straight line through all but the left- most 
data-point for (S). This indicates that (S) decreases as D~^^^. The inset gives the "degeneracy fraction", also as a function of 
the sector dimension, for the 21 nearest-neighbor interactions. 
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